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(54) Digital data encode system 

(57) A digital data encode system for inserting water 
mark data into digital data signals having a series of 
field data by use of a water mark data inserting device 
(140), said digital data encode system comprising a 
field judging unit (120) dividing the digital data signals 
by a predetermined reference, a water mark data selec- 
tion output unit (130) for selecting proper one of a plural- 

FIG. 



ity of different water mark data prepared correspon- 
dingly to the division according to the judgement result 
of the field judging unit (120), and a water mark data 
inserting device (140) for inserting the water mark data 
supplied from the water mark data selection output unit 
(130) into the digital data signals. 
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Description 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention relates to a digital data 
encode system and a water mark data inserting method 
for inserting water mark data in the digital data signal 
having a series of field data. 

DESCRIPTION OF THE RELATED ART 

Recently, there has arisen the necessity of develop- 
ing means for preventing illegal copying of digital data, 
especially digital image data, with the advance of an 
information processor and a communication network 
and the electronization of various media. 

Data encryption technique has been proposed as 
this kind of technique for preventing illegal copying. This 
digital data encryption technique is, for example, to ena- 
ble it to reproduce the encrypted digital image data in 
only a reproducing system having a proper cryptoanaly- 
sis key when digital image data is encrypted. The con- 
ventional encryption technique, however, has such a 
defect that if the encryption code is once broken, it can- 
not protect against the illegally copying thereafter. 

Therefore, a technique by use of water mark data is 
proposed, as another technique for preventing illegal 
copying of digital data, free from such a defect as a dig- 
ital encryption technique has. Water mark data (digital 
water mark) is the special information to be embedded 
in digital image data itself in order to prevent the illegal 
use and copying of the digital image data. It includes, for 
example, information for authenticating the copyright 
ownership and judging the infringement of the copy- 
right, and the copy protected information for preventing 
illegal copying itself. 

Such water mark data to be inserted in the digital 
image data includes two kinds of visible water mark 
data and invisible water mark data. Visible water mark 
data means such a special character, symbol, or other 
data to be inserted in the image that a person who sees 
the image with the water mark data combined therewith 
may perceive the water mark visually. This kind of visi- 
ble water mark data would naturally cause the deterio- 
ration of the image quality. While, it is effective in 
visually appealing protection against illegal copy or ille- 
gal data fluid. 

A conventional visible water mark data embedding 
technique is disclosed in, for example, Japanese Patent 
Publication Laid-Open (Kokai) No. Heisei 8-241403, 
"Digital Watermarking Free from Image Color Change" 
(hereinafter, referred to as the conventional technique 
1). According to the water mark data inserting method 
of the conventional technique 1 , when combining visible 
water mark data with the original image data, the water 
mark data is combined with the original image data in a 



way of changing only the brightness of the pixel corre- 
sponding to the non-transparent part of the water mark 
data without changing the chromaticities, of all pixels of 
the original data. At this time, the scaling value for 
5 changing the brightness component of a pixel is deter- 
mined by the value of, for example, chromatic compo- 
nent, random numbers, and pixels of water mark data. 

Another example of the conventional visible water 
mark data embedding technique is disclosed in, for 
io example, Japanese Patent Publication Laid-Open 
(Kokai) No. Heisei 5-236424, "Information Embedding 
Method and Its Apparatus" (hereinafter, referred to as 
the conventional technique 2). The water mark data 
inserting method according to the conventional tech- 
15 nique 2 comprises detecting means for detecting a 
region meeting a predetermined condition from image 
data, thereby to embed the water mark in every image 
data at the position corresponding to the region meeting 
the condition. The position for embedding the water 
20 mark depends on the content of the image. Therefore, it 
is very difficult to remove the water mark without much 
deteriorating the image quality. 

On the other hand, invisible water mark data means 
such special data to be inserted in the image that a per- 
25 son who sees the image with the water mark data com- 
bined therewith cannot perceive the water mark visually. 
This kind of invisible water mark data is embedded in 
the original image data in consideration of causing no 
natural deterioration of the image quality. As is under- 
go stood from this, invisible water mark data is preferable to 
visible water mark data under the condition that a water 
mark preferably exists outside of the image data to be 
protected. 

The water mark data inserting technique by use of 

35 an invisible water mark causes little image deterioration 
and when embedding special information enabling the 
identification of a writer as water mark data, it can spec- 
ify the writer by detecting the water mark data even after 
illegal copying is performed. By embedding the copy 

40 protected information for disapproving copying or the 
copy prohibited information for prohibiting copying, in 
the original image data, and providing a reproducing 
device for reproducing the image data with a special 
function corresponding to the information, for example, 

45 it is possible to notify a user of the reproducing device 
that the image data is the copy inhibited data and to 
operate the special function within the reproducing 
device (copy protection function or the like) so as to 
restrict copying into VTR (Video Tape Recorder) when 

so the reproducing device detects the copy protected infor- 
mation or the like. 

As the technique of embedding the invisible water 
mark data in digital image, there is, for example, a tech- 
nique of embedding the special information as a water 

55 mark in the digital image at the least influenced portion 
to the image quality in the pixel data (for example, LSB 
(Least Significant Bit)). This kind of the conventional 
invisible water mark data embedding technique is dis- 
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closed in, for example, Japanese Patent Publication 
Laid-Open (Kokai) No. Heisei 6-339110. "Image Infor- 
mation Transfer Method, Image Information Recording 
Device and Image Information Reproducing Device" 
(hereinafter, referred to as the conventional technique 
3). The water mark data inserting method according to 
the conventional technique 3 transmits the image signal 
together with the copyright information and the genera- 
tion information overlapping each other, to the space 
other than the valid image space displayed on a screen 
of the image signal, and performs the generation restric- 
tion of the copy according to the copyright information 
and the generation information included in the received 
image signal at a receiver side. 

The invisible water mark data embedding tech- 
nique, however, is defective in that only the water mark 
data is easily removed from the image data with water 
mark data embedded therein, without deteriorating the 
quality of the original image data. For example, the 
information corresponding to the LSB of the pixel data 
will be lost by use of a low pass filter. Generally, the 
image compression processing aims to reduce the data 
amount on the whole by diminishing the information 
amount with respect to the least influenced portion to 
the quality in the pixel data. Therefore, the water mark 
data embedded in the least influenced portion to the 
quality in the pixel data will be lost in the image com- 
pression processing. As mentioned above, the invisible 
water mark embedding technique has such a defect that 
it may be difficult to re<Jetect the water mark data in 
some cases. 

Therefore, a technique of embedding invisible 
water mark data in a digital image as well as diffusing 
the water mark data into the frequency spectrum after 
frequency conversion of the image data (hereinafter, 
referred to as the conventional technique 4) is pre- 
sented (refer to Nikkei Electronics p. 13 (no. 660) 
4.22.1996). Since water mark data is embedded in the 
frequency component of the image data to be proc- 
essed according to the conventional technique 4, the 
water mark data is robust against the image compres- 
sion processing and the image processing such as fil- 
tering, and the water mark data won't be lost. Further, 
random numbers according to the normal distribution 
are used as the water mark data, thereby preventing the 
interference of the respective water mark data even in 
the case of embedding a plurality of water mark data. 
Therefore, according to the conventional technique 4, it 
is difficult to destroy only the water mark data without 
much influence to the whole image data. 

The conventional technique 4 will be, hereinafter, 
described with reference to Fig. 12. The water mark 
encode system according to the conventional technique 
4 comprises, for example, discrete cosine transform 
(DCT) means 1210, water mark data output means 
1230 storing the water mark data 1231, a water mark 
data inserting device 1240, and inverse discrete cosine 
transform (inverse DCT) means 1250. The DCT is 



adopted here as only one example of spectrally resolv- 
ing means of original image data, and any other conver- 
sion means than the DCT will do. 

In thus-constituted conventional technique 4, origi- 

s nal image data is converted into frequency components 
by DCT, and n piece of data indicating higher frequency 

value are selected, each defined as f(1), f(2) 

f(n). On the other hand, each water mark data w(1), 
w(2) w(n) are selected from the normal distribution 

10 having a mean value 0 and a variance 1, and 
F(i)=f(i) + a | f(i) | * w(i) is calculated with respect to 
each i (where i=1 , 2, .... n: hereinafter in the same way). 
Where, a is a scaling element. At the end, the image 
data with the water mark data embedded therein can be 

15 obtained as the frequency components by the replace- 
ment of f(i) with F(i). 

The water mark data detection according to the 
conventional technique 4 is performed in the following 
method, by way of example. The original image data 

20 and the water mark data candidate w(i) must be known 
values in the detecting method of the conventional tech- 
nique 4. At first, the image data with the water mark data 
embedded therein is converted into the frequency com- 
ponents by use of DCT or the like, the element values 

25 corresponding to f(1 ), f(2), .... f(n) having the water mark 
data embedded therein in the frequency band are 

defined as F(1), F(2) F(n). By the use of f(i) and F(i), 

the water mark data W(i) is extracted, calculated by 
W(i)=(F(i) - f(i))/f(i) . Next, the statistical similarity C of 

30 w(i) and W(i) is calculated by use of the inner product of 
vector by C = W * w / (WD * wD) . Where, W = (W(1), 

W(2) W(n)), and w = (w(1), w(2) w(n)), WD is the 

absolute value of the vector W, and wD is the absolute 
value of the vector w. As the result of the above calcula- 

35 tion, when the statistical similarity C is a particular con- 
stant value or the more, it can be judged that the above- 
mentioned water mark data candidate has been embed- 
ded in the image data. 

If creating the image data with the water mark 

40 embedded therein by embedding the water mark data in 
the original image data by use of the conventional tech- 
nique 4 as mentioned above, it is effective for a writer 
owing the original image data to judge the illegality of 
the digital image data which may be illegal copy. 

45 The conventional technique 4 requires original 
image data and water mark data candidate w(i) in order 
to detect the water mark data as mentioned above. 
Therefore, it is effective for a writer owing the original 
image to detect any illegally-copied image data, how- 

so ever, a reproducing device of a terminal used by a gen- 
eral user, because of having no original image, cannot 
perform the detecting processing of the water mark 
data. Then, a further improved technique than the con- 
ventional technique 4 for terminal processing, espe- 

55 cially MPEG system (hereinafter, referred to as the 
conventional technique 5) is proposed. 

In the conventional technique 5, original image is 
divided into blocks of 8 pixels x 8 pixels and the water 
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mark data embedding and detection is performed by 
use of the block unit for processing. In the water mark 
data embedding processing, the data is defined as 

f(1), f(2) f(n) sequentially from the lowest frequency 

component of AC component in the frequency band 5 
after discrete cosine transform in the MPEG encode 
processing, the water mark data w(1), w(2), .... w(n) 
are selected from the normal distribution having a 
mean value 0 and a variance 1 , and 
F(i)=f(i) + a x avg (f(i)) x w(i) is calculated with 10 
respect to each i. Where, a is a scaling element and avg 
(f(i)) is a partial average obtained by averaging the 
absolute values of three points around f(i), for example, 
f(i-1). f(0. and f(i + 1). The processing later than the 
MPEG encode processing will be performed by replac- 75 
ing f(i) with F(i). 

On the other hand, detection of the water mark data 
will be performed in the following method. This detecting 
method requires no original image data and that only 

the data candidate w(i) (where, U=1, 2 n) must be a 20 

known value. In the block frequency band of blocks after 
inverse quantization of the MPEG decoding processing, 
the data from the lowest frequency component is 
sequentially defined as F(1), F(2), .... F(n). The average 
of the absolute values of three points around F(i) is 25 
defined as the partial average avg (F(i)), the water mark 
data W(i) is calculated by W(i)=F(i)/avg (F(i)) , and the 
total WF(i) of W(i) for one image is calculated for every 
i. By use of the inner product of vectors, the statistical 
similarity of w(i) and WF(i) is calculated by 30 
C=WF x w/(WFD x wD) . Where, W=(WF(1), WF(2), 
.... WF(n)), w=(w(1), w(2) w(n)), WFD is the abso- 
lute value of the vector WF, and wD is the absolute value 
of the vector w. When the statistical similarity C is a par- 
ticular constant value or the more, it can be judged that 35 
the water mark data has been embedded in the image 
data. 

Insertion of a plurality of water mark data into one 
original image data can be adopted in order to attach a 
plurality of information such as writer information and 40 
copy protected information, to one image data. The con- 
ventional techniques 4 and 5, however, is defective in 
making the circuit size larger because of inserting a plu- 
rality of water mark data in one original image data and 
increasing the processing procedure. Namely, the con- 45 
ventional techniques 4 and 5 disclose a technique of 
inserting one water mark data in one original image 
data, however, with no consideration taken to the case 
of inserting a plurality of water mark data (for example, 
two water mark data) in one original image data. There- so 
fore, when inserting, for example, two water mark data 
therein, different water mark data 1231 and 1232 must 
be separately inserted by two water mark data inserting 
devices 1 241 and 1 242, or two water mark data must be 
inserted by letting them pass one water mark data ss 
inserting device twice. 

Another example of the conventional technique of 
embedding water mark in a digital image is disclosed in 



Japanese Patent Publication Laid-Open (Kokai) No. 
Heisei 6-315131, "Information Embedding Device And 
Reproducing Device" (hereinafter, referred to as the 
conventional technique 6). The conventional technique 
6 detects an area having no deterioration of the image 
even if replacing the data at the peripheral area when 
reproducing the information, for example, an equal 
background portion, by use of the relationship between 
a series of frames, and converts the level of the area to 
be converted, so to embed particular information 
therein. When reproducing the information, the area 
with the identification data embedded therein is speci- 
fied by use of the signal lacked portion and the conver- 
sion information, and corrected so as to reconstruct the 
image. 

The conventional technique 6, however, cannot 
embed the water mark information in all the frames, so 
that the frame with no water mark embedded therein is 
unable to protect against illegal copying. Since this tech- 
nique is on the assumption that successive frames are 
of freeze-frame pictures and that there is no change on 
the successive frames, an area for embedding the water 
mark data cannot be specified in the moving images of 
violence action, thereby making it impossible to embed 
the water mark data therein. 

Further another example of the conventional tech- 
nique of embedding water mark in a digital image is dis- 
closed in, for example, Japanese Patent Publication 
Laid-Open (Kokai) No. Heisei 5-30466, "Image Signal 
Recording Device and Signal Recording Medium" 
(hereinafter, referred to as the conventional technique 
7). The conventional technique 7 converts image sig- 
nals by frequency and embeds the information having 
the frequency signal lower than the frequency band of 
the image signal after frequency conversion. By the use 
of a high pass filter, the original image is taken out and 
the identification data embedded therein is taken out by 
the use of a low pass filter. 

However, since the conventional technique 7 
embeds the water mark data in the lower frequency por- 
tion in the frequency band after frequency conversion of 
the image data, the water mark data can be easily 
removed by use of a high pass filter. When embedding 
the water mark data jn the intensive frequency portion 
after frequency conversion, a filter cannot remove the 
water mark, but when inserting a plurality of water mark 
data, it cannot help deteriorating the image quality. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
digital data encode system and a water mark data 
inserting method capable of inserting a plurality of water 
mark data in one original image data. 

Another object of the present invention is, in addi- 
tion to the above object, to provide a digital data encode 
system and a water mark data inserting method capa- 
ble of inserting a plurality of water mark data in one orig- 
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inal image data in the circuit of the same size as that of 
the conventional digital data encode system. 

According to the first aspect of the invention, a dig- 
ital data encode system having a water mark data 
inserting device for inserting water mark data into digital 
data signals having a series of field data, comprising, 

a water mark data inserting control means for con- 
trolling inserting of the water mark by the water 
mark data inserting device; 

wherein the water mark data inserting con- 
trol means divides the digital data signals by a pre- 
determined reference and inserts a plurality of 
different water mark data prepared correspondingly 
to the division into the respective digital data of the 
corresponding divisions by use of the water mark 
data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields and even fields of a series 
of image frames, and the water mark data inserting con- 
trol means inserts first and second water mark data dif- 
ferent from each other and prepared for every odd filed 
and every even field into the respective corresponding 
fields, by use of the water mark data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields and even fields in a series 
of image frames, and the water data inserting control 
means comprising a field judging means for judging 
whether the filed data under processing is of an odd 
field or an even field upon receipt of the digital data sig- 
nals, and a water mark data selection output means, 
storing first and second water mark data different from 
each other and prepared for every odd field and every 
even field, for supplying the first water mark data to the 
water mark data inserting device when the judgement 
result designates the odd field, or supplying the second 
water mark data to the water mark data inserting device 
when the judgement result designates the even filed, 
depending on the judgement result by the field judging 
means. 

In the preferred construction, the water mark data 
inserting control means inserts a plurality of different 
water mark data prepared for every signal component of 
the digital data signals extracted by a predetermined 
reference into the respective digital data signals of the 
corresponding signal components, by use of the water 
mark data inserting device. 

In the preferred construction, the water mark data 
inserting control means comprising a signal component 
judging means for, upon receipt of the digital data sig- 
nals, judging whether the signal component of the dig- 
ital data signal under processing is brightness 
component, first color-difference component, or second 
color-difference component, and a water mark data 
selection output means, storing three kinds of different 



water mark data prepared for every signal component of 
the above three kinds, for supplying the water mark data 
prepared correspondingly to the brightness component 
to the water mark data inserting device when the judg- 

5 ing result designates the brightness component, sup- 
plying the water mark data prepared correspondingly to 
the first color-difference component to the water mark 
data inserting device when the judgement result desig- 
nates the first color-difference component, or supplying 

10 the water mark data prepared correspondingly to the 
second color-difference component to the water mark 
data inserting device when the judgement result desig- 
nates the second color-difference component, depend- 
ing on the judgement result of the signal component 

rs judging means. 

In another preferred construction, the water mark 
data inserting control means comprising a signal com- 
ponent judging means for, upon receipt of the digital 
data signals, judging whether the signal component of 

20 the digital data signal under processing is red-compo- 
nent, green-component, or blue-component, and a 
water mark data selection output means, storing three 
kinds of different water mark data prepared for every 
signal component of the above three kinds, for supply- 

25 ing the water mark data prepared correspondingly to the 
red-component to the water mark data inserting device 
when the judgement result designates the red-compo- 
nent, supplying the water mark data prepared corre- 
spondingly to the green-component to the water mark 

30 data inserting device when the judgement result desig- 
nates the green-component, or supplying the water 
mark data prepared correspondingly to the blue-compo- 
nent to the water mark data inserting device when the 
judgement result designates the blue-component, 

35 depending on the judgement result of the signal compo- 
nent judging means. 

In another preferred construction, the digital data 
encode system further comprises a spectrally-resolving 
means for spectrally resolving the digital data signals 

40 upon receipt of them and supplying the obtained 
resolved signals to the water mark data inserting device 
as a subject of inserting the water mark data therein. 

In another preferred construction the digital data 
encode system further comprises a spectrally-resolving 

45 means for spectrally resolving the digital data signals 
upon receipt of then, and supplying the obtained 
resolved signals, as a subject of inserting the water 
mark data therein, to the water mark data inserting 
device, and an inversely-converting means, receiving 

so the processed signals with the water mark data inserted 
therein by the water mark data inserting device, for 
inversely converting the spectrally-resolved data and 
supplying the obtained inversely-converted signals as 
water mark-embedded digital data signals. 

55 In another preferred construction the digital data 
encode system further comprises a discrete cosine 
transform means for performing discrete cosine trans- 
form on the digital data signals upon receipt of them and 
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supplying the obtained transformed signals to the water 
mark data inserting device as a subject of inserting the 
water mark data therein, and an inverse discrete cosine 
transform means, receiving the processed signals with 
the water mark data inserted therein by the water mark 5 
data inserting device, for performing inverse discrete 
cosine transform on them and supplying the obtained 
inversely-transformed signals as water mark-embedded 
digital data signals. 

In another preferred construction, the digital data w 
encode system further comprises a spectrally-resolving 
means for spectrally resolving the digital data signals 
upon receipt of them and supplying the obtained 
resolved signals to the water mark data inserting device 
as a subject of inserting the water mark data therein, a is 
sampling means for sampling the processed signals 
with the water mark data inserted therein by the water 
mark data inserting device to supply sampling signals, 
and an image compression means for converting the 
sampling signals into image-compressed signals and 20 
supplying the obtained digital data compression data 
signals with the water mark embedded therein. 

In another preferred construction, the digital data 
signals being of a digital data signal consisting of a 
series of image frames, 2 s 

further comprises an encoding means for encod- 
ing the digital signals with the water mark data inserted 
therein by use of the water mark data inserting device, 
and an encode controlling means for controlling the 
encoding means so to perform encoding processing in a 30 
plurality of kinds of picture types corresponding to the 
encoding methods, 

the water mark data inserting control means 
comprises water mark data storing means for storing a 
plurality of different water mark data prepared corre- 35 
spondingly to a plurality of picture types for use in the 
encoding means and the encode controlling means, 
and a water mark data selection output means for, 
depending on the picture type decided by the encode 
controlling means, selecting the corresponding water 40 
mark data from the water mark data storing means and 
supplying it to the water mark data inserting device. 

In another preferred construction, the digital data 
signals being of a digital data signal consisting of a 
series of image frames, 45 

further comprises a spectrally-resolving means 
for dividing the image of the digital data signals into 
blocks of a predetermined size, spectrally resolving the 
corresponding digital data signals in every block, and 
supplying the obtained resolved signals to the water so 
mark data inserting device as a subject of inserting the 
water mark data therein, an encoding means for encod- 
ing the digital signals with the water mark data inserted 
therein by use of the water mark data inserting device, 
and an encode controlling means for controlling the ss 
encoding means so to perform encoding processing in a 
plurality of kinds of picture types, 

the water mark data inserting control means 



comprises water mark data storing means for storing a 
plurality of different water mark data prepared corre- 
spondingly to a plurality of picture types for use in the 
encoding means and the encode controlling means, 
and a water mark data selection output means for, 
depending on the picture type decided by the encode 
controlling means, selecting the corresponding water 
mark data from the water mark data storing means and 
supplying it to the water mark data inserting device, 

the water mark data inserting device comprises a 
partial average calculator for calculating the average of 
the absolute values of three points around each ele- 
ment in the resolved signals supplied from the spec- 
trally-resolving means, as a partial average, a first 
multiplier for multiplying the water mark data supplied 
from the water mark data inserting control means by the 
output data of the partial average calculator in every 
element, a second multiplier for multiplying each ele- 
ment of the output data of the first multiplier by a prede- 
termined constant, and an adder for adding the output 
data of the second multiplier and the resolved signals 
supplied from the spectrally-resolving means in every 
element. 

According to the second aspect of the invention, a 
digital data encode system having a water mark data 
inserting unit including a water mark data inserting con- 
trol means for inserting water mark data into digital data 
signals having a series of field data by control of a water 
mark data inserting device and a water mark data 
detecting unit including a water mark data detecting 
means for detecting the water mark data from the digital 
data signals with the water mark data added thereto by 
the water mark data inserting unit, 

the digital data signals being of a digital data sig- 
nal consisting of a series of image frames; 

the water mark data inserting unit further com- 
prising 

an encoding means for encoding the digital data 
signals with the water mark data inserted therein by 
use of the water mark data inserting device, and 
an encode controlling means for controlling the 
encoding means so to perform encoding process- 
ing in a plurality of kinds of picture types corre- 
sponding to the encoding methods; 
the water mark data inserting control means com- 
prising 

first water mark data storing means for storing a 
plurality of different water mark data prepared cor- 
respondingly to a plurality of picture types for use in 
the encoding means and the encode controlling 
means, and 

a water mark data selection output means for, 
depending on the picture type decided by the 
encode controlling means, selecting the corre- 
sponding water mark data from the first water mark 
data storing means and supplying it to the water 
mark data inserting device, 



In the preferred construction, the water mark data 
inserting unit further comprises a spectrally-resolving 
means for dividing the image of the digital data signals 
into blocks of a predetermined size, spectrally resolving 
the corresponding digital data signals in every block, 
and supplying the obtained resolved signals to the 
water mark data inserting device as a subject of insert- 
ing the water mark data therein; 
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average calculator for calculating the average of the 
absolute values of three points around the block 
data decoded by the decoding means as a partial 
average, and a divider for dividing the block data 
decoded by the decoding means by the output data 
of the partial average calculator. 

According to the third aspect of the invention, a 
water mark data inserting method for inserting water 
mark data in digital data signals having a series of field 
data by use of a water mark data inserting device, com- 
prising 

a step of, after dividing the digital data signals by a 
predetermined reference, inserting a plurality of dif- 
ferent water mark data prepared correspondingly to 
the division into the respective digital data of the 
corresponding divisions, by use of the water mark 
data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields and even fields of a series 
of image frames, 

further comprising the steps of: 

a step of storing first and second water mark data 
different from each other and prepared for every 
odd field and every even field, - ; 
a step of judging whether the digital data signal is of 
the odd field or the even field one after another, - 
a step of selecting one of the first and second water 
mark data as the water mark data to be inserted in 
the digital data signals, according to the judgement 
result in the field judging step, 
a step of spectrally resolving the digital data sig- 
nals, and 

a step of, with respect to the frequency analyzed 
data, as a subject of inserting the water mark data 
therein, obtained as a result of the spectrum resolu- 
tion in the spectrally resolving step, inserting the 
first water mark data into the frequency analyzed 
data of the odd field or inserting the second water 
mark data into the frequency analyzed data of the 
even filed, according to the selection result in the 
water mark data selecting step. 

In the preferred construction, the water mark data 
inserting method further comprises a step of storing 
three kinds of different water mark data prepared for 
every brightness component, first color-difference com- 
ponent, and second color-difference component in the 
signal components of the digital data signals, a step of 
judging the signal components of the digital data signals 
one after another, a step of selecting one of the above 
three kinds of water mark data as the water mark data 
to be inserted in the digital signal data, according to the 
judgement result in the signal component judging step, 



the water mark data inserting device comprises a 
partial average calculator for calculating the aver- 
age of the absolute values of three points around 45 
each element in the resolved signals supplied from 
the spectrally-resolving means, as a partial aver- 
age, a first multiplier for multiplying the water mark 
data supplied from the water mark data inserting 
control means by the output data of the partial aver- so 
age calculator in every element, a second multiplier 
for multiplying each element of the output data of 
the first multiplier by a predetermined constant, and 
an adder for adding the output data of the second 
multiplier and the resolved signals supplied from ss 
the spectrally-resolving means in every element, 
the water mark data extracting device of the water 
mark data detecting means comprises a partial 
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the water mark detecting unit comprising 
a decoding means for decoding the digital data sig> 
nals encoded by the encoding means of the water 
mark data inserting device, and 
a display controlling means for controlling display 5 
depending on the data decoded by the decoding 
means according to the content of the water mark 
data inserted in the digital data signals or according 
to its presence; 

the water mark data detecting means comprising 10 
a water mark data extracting device for extracting 
candidate data, that is a candidate of the water 
mark data, from the data decoded by the decoding 
means, 

a second water mark data storing means for storing 15 
the same water, mark data as the plurality of water 
mark data stored in the first water mark data storing 
means of the water mark data inserting control 
means in the water mark data inserting device, 
a water mark data selection output means for 20 
selecting the corresponding water mark data from 
the second water mark data storing means accord- 
ing to the picture type in the encoding processing to 
be recognized in the decoding processing by the 
decoding means and supplying it, and 25 
a statistical similarity judging mean for making a 
comparison between the candidate data extracted 
by the water mark data extracting device and the 
water mark data supplied by the water mark data 
selection output means, judging the statistical simi- 30 
larity thereof, and notifying the display controlling 
means of the judgement result. 
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a step of spectrally resolving the digital data signals, 
and a step of, with respect to the frequency analyzed 
data, as a subject of inserting the water mark data 
therein, obtained as a result of the spectrum resolution 
in the spectrally resolving step, inserting the water mark 5 
data prepared correspondingly to the brightness com- 
ponent into the data of the brightness component, 
inserting the water mark data prepared correspondingly 
to the first color-difference component into the data of 
the first color-difference component, or inserting the 10 
water mark data prepared correspondingly to the sec- 
ond color-difference component into the data of the sec- 
ond color-difference component, according to the 
selection result in the water mark data selecting step. 

In the preferred construction, the water mark data is 
inserting method further comprises a step of storing 
three kinds of different water mark data prepared for 
every red-component, green-component, and blue- 
component in the signal components of the digital data 
signals, a step of judging the signal components of the 20 
digital data signals one after another, a step of selecting 
one of the above three kinds of water mark data as the 
water mark data to be inserted in the digital signal data, 
according to the judgement result in the signal compo- 
nent judging step, a step of spectrally resolving the dig- 25 
ital data signals, and a step of, with respect to the 
frequency analyzed data, as a subject of inserting the 
water mark data, obtained as a result of the spectrum 
resolution in the spectrally resolving step, inserting the 
water mark data prepared correspondingly to the red- 30 
component into the data of the red-component, insert- 
ing the water mark data prepared correspondingly to the 
green-component into the data of the green-compo- 
nent, or inserting the water mark data prepared corre- 
spondingly to the blue-component into the data of the 35 
blue-component, according to the selection result in the 
water mark data selecting step. 

In another preferred construction, the water mark 
data inserting method further comprises a step of stor- 
ing a plurality of different water mark data prepared for 40 
every plurality of picture types corresponding to the 
encoding methods in encoding the digital data signals, a 
step of judging the signal components of the digital data 
signals one after another, a step of selecting one of the 
above three kinds of water mark data, as the water mark 45 
data to be inserted in the digital signal data, according 
to the judgement result in the signal component judging 
step, a step of spectrally resolving the digital data sig- 
nals, and a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water mark data so 
therein, obtained as a result of the spectrum resolution 
in the spectrally resolving step, inserting the water mark 
data prepared correspondingly to the picture type, 
according to the selection result in the water mark data 
selecting step. 55 

According to another aspect of the invention, a 
computer readable memory for storing a control pro- 
gram for controlling a digital data encode system having 



a water mark data inserting control means for inserting 
water mark data into digital data signals having a series 
of field data by use of a water mark data inserting 
device, the control program comprising 

a step of, after dividing the digital data signals by a 
predetermined reference, inserting a plurality of dif- 
ferent water mark data prepared correspondingly to 
the division into the respective digital data of the 
corresponding division, by use of the water mark 
data inserting device. 

Other objects, features and advantages of the 
present invention will become clear from the detailed 
description given herebelow. 

BRIEF DESCRIPTION! OF THE DRAWING 

The present invention will be understood more fully 
from the detailed description given herebelow and from 
the accompanying drawings of the preferred embodi- 
ment of the invention, which, however, should not be 
taken to be limitative to the invention, but are for expla- 
nation and understanding only. 

In the drawings: 

Fig. 1 is a block diagram showing a constitution of a 
digital data encode system according to a first 
embodiment of the present invention. 
Fig. 2 is a flow chart showing an operation of the 
first embodiment. 

Fig. 3 is a block diagram showing a constitution of a 
digital data encode system according to a second 
embodiment of the present invention. 
Fig. 4 is a flow chart showing an operation of the 
second embodiment. 

Fig. 5 is a block diagram showing a constitution of a 
digital data encode system according to a third 
embodiment of the present invention. 
Fig. 6 is a flow chart showing an operation of the 
third embodiment. 

Fig. 7 is a block diagram showing a constitution of a 

digital data encode system according to a fourth 

embodiment of the present invention. 

Fig. 8 is a block diagram showing a constitution of a 

digital data encode system according to a fifth 

embodiment of the present invention. 

Fig. 9 is a flow chart showing an operation of the 

fifth embodiment. 

Fig. 10 is a block diagram showing a constitution of 

a detecting device for detecting the water mark from 

the data having the water mark inserted therein 

according to the fifth embodiment. 

Fig. 1 1 is a flow chart showing an operation of the 

detecting device of Fig. 10. 

Fig. 12 is a block diagram showing a constitutional 

example of the conventional digital encode system. 

Fig. 13 is a block diagram showing another consti- 
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tutional example of the conventional digital data 
encode system. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

The preferred embodiment of the present invention 
will be discussed hereinafter in detail with reference to 
the accompanying drawings. In the following descrip- 
tion, numerous specific details are set forth in order to 
provide a thorough understanding of the present inven- 
tion. It will be obvious) however, to those skilled in the 
art that the present invention may be practiced without 
these specific details. In other instance, well-known 
structures are not shown in detail in order to unneces- 
sary obscure the present invention. 

Fig. 1 is a block diagram showing a constitution of a 
digital data encode system according to a first embodi- 
ment of the present invention. With reference to Fig. 1, 
the encode system of the embodiment comprises a 
DCT (discrete cosine transform) unit 1 10, a field judging 
unit 120, a water mark data selection output unit 130, a 
water mark data inserting device 140, and an inverse 
DCT (inverse discrete cosine transform) unit 150. Fig. 1 
shows only the characteristic components of the 
embodiment, while the description of other general 
components is not shown there. 

Each component may be realized by an information 
processor and a storage controlled by a computer pro- 
gram (hereinafter, referred to as a control program) in a 
personal computer, a work station or the other computer 
system. The information processor includes an internal 
memory for storing data, a signal input port, and a sig- 
nal output port, and executes processing according to 
the control program. Any signal input port will do as far 
as it can receive original image data or its correspond- 
ing data, and any signal output port will do as far as it 
can supply the water mark-embedded image data, 
water mark-embedded MPEG stream, or its corre- 
sponding data. The control program can be provided 
stored in a magnetic disk, a semiconductor memory, or 
other storing medium, so to be loaded in the information 
processor. A storing medium is not restricted to a partic- 
ular form, but will do as far as an information processor 
can read out therefrom. 

In the above components, upon receipt of the digital 
data signal (hereinafter, referred to as the original image 
data) 101 having a series of field data consisting of odd 
fields and even fields in a series of image frames, the 
DCT unit 110 performs discrete cosine transform and 
supplies a frequency component signal 1 02 to the water 
mark data inserting device 140. The original image data 
having such a data structure includes a digitalized inter- 
lace signal obtained by interlaced scanning, for exam- 
ple, similarly to the television signal in NTSC (National 
Television System Committee) method. In this case, the 
original image data 101 has a data structure where odd 
fields and even fields are disposed by turns. However, in 
the present invention, it is not restricted to this structure 
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but it will do as far as the boundary between each field 
is definite. 

The field judging unit 120, upon receipt of the origi- 
nal image data 101, judges whether the field under 

5 processing is odd field or even field, and supplies the 
field judgement information 103 indicating the judge- 
ment result to the water mark data selection output unit 
130. Field may be judged by use of a synchronous sig- 
nal, for example, in case of the interlaced signal as men- 

10 tioned above. Alternatively, when the original image 
data 101 has a data structure where another informa- 
tion for indicating odd field or even field is attached to 
each field, field may be judged by use of the information. 
Namely, it is preferable to select and change the field 

is judgement method in the field judging unit 120 properly 
according to the data structure of the original image 
data 101. 

The water mark data selection output unit 130 is 
storing a first and second water mark data 131 and 132. 

20 The water mark data selection output unit 130, upon 
receipt of the field judgement information 103 supplied 
from the field judging unit 120, judges whether the field 
judgement information 103 designates an odd field or 
an even field. Further, the water mark data selection 

25 output unit 130 selects the first water mark data 131 
when the field judgement information 1 03 designates an 
odd field, and supplies it as the water mark data 104 to 
the water mark data inserting device 140. While, the 
water mark data selection output unit 130 selects the 

30 second water mark data 132 when the field judgement 
information 103 designates an even field, and supplies 
it as the water mark data 104 to the water mark data 
inserting device 140. 

The water mark data inserting device 140, upon 

35 receipt of the frequency component signal 102 from the 
DCT unit 110 and the water mark data 104 selected and 
supplied by the water mark data selection output unit 
130, inserts the water mark data 104 in the frequency 
component signal 1 02 and supplies the frequency com- 

40 ponent signal 105 with the water mark-embedded 
therein to the inverse DCT unit 150. The water mark 
data inserting device 140 may have the same structure 
as the water mark data inserting device 1240 of the 
above-mentioned conventional technique 4. The fre- 

45 quency component signal 102 is obtained by converting 
the original image data 101 in the frequency compo- 
nents, naturally including the content corresponding to 
the odd and even fields. The water mark data 104 
received from the water mark data selection output unit 

so 130 is selected correspondingly to the field as men- 
tioned above. According, even in the case where the 
water mark data inserting device 140 has the same 
structure as the conventional technique, if the water 
mark data 104 is inserted in the frequency component 

55 signal 102 according to the selection result of the water 
mark data selection output unit 130, the first water mark 
data 131 can be embedded in the content correspond- 
ing to the odd field of the original image data 101 and 
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the second water mark data 132 can be embedded in 
the content corresponding to the even field. 

Upon receipt of the water mark-embedded fre- 
quency component signal 105 supplied from the water 
mark data inserting device 140, the inverse DCT unit s 
150 performs inverse discrete cosine transform and 
supplies the water mark-embedded image data 106. 

With reference to the flow chart of Fig. 2, an opera- 
tion of the embodiment will be described. As mentioned 
above, when realizing the encode system of the embod- 10 
iment in a computer system, a control program for con- 
trolling the information processor includes, at least, 
instructions for the information processor performing 
the following respective steps, thereby making the infor- 
mation processor insert the water mark data in the orig- is 
inal image data supplied from the signal input port. 

At first, the first and second water mark data 131 
and 132 are stored into the memory of the water mark 
data selection output unit 130 (Step 201). At this time, 
the first and second water mark data 131 and 132 may 20 
be provided stored in the same storing medium together 
with the control program, or they may be provided sep- 
arately from the control program, which is not subject to 
any restriction. 

When the signal input port receives the original 25 
image date 101. the field judging unit 120 makes a 
judgement of the field with respect to the received origi- 
nal data one after another whether it Ms an odd field or 
an even field (Step 202). 

According to the judgement result by the field judg- 30 
ing unit 120 in Step 202. the water mark data selection 
output unit 130 selectively assigns the first water mark 
data to the odd field and the second water mark data to 
the even field and supplies as such (Step 203). 

The DCT unit 110 performs the discrete cosine 35 
transform processing on the received original image 
data 101 (Step 204). Any processing will do in this step 
as far as it is the processing of converting the original 
image data 101 in the frequency components by the 
spectrum resolution. Though this step is positioned 40 
after Step 203 in Fig. 2, it shall be actually performed 
simultaneously with Steps 202 and 203. 

The water mark data inserting device 140, accord- 
ing to the selection result of the water mark data selec- 
tion output unit 130 in Step 203, inserts the first water 45 
mark data in the odd field and inserts the second water 
mark data in the even field (Step 205), in the resultant 
data 102 obtained through the spectrum resolution by 
the DCT unit 1 10 in Step 204. 

The inverse DCT unit 105 thereafter converts the so 
water mark-embedded frequency component signal 
105 supplied from the water mark data inserting device 
140 into the image data and supplies the same (Step 
206). 

Thus, according to the digital data encode system ss 
of this embodiment, the water mark-embedded image 
data with two water mark data embedded therein can be 
obtained. Further, according the embodiment, two 



water mark data can be inserted by the use of one water 
mark data inserting device. Therefore, two water mark 
data can be inserted by use of the same circuit size as 
the conventional technique 4. 

To make the description clearly, this embodiment 
has been described with individual functions as the 
DCT unit 1 10, the field judging unit 120, the water mark 
data selection output unit 130, and the water mark data 
inserting device 140. Otherwise they may be all inte- 
grated in water mark data inserting means. At this time, 
the signal supplied from the water mark data inserting 
means is the same as the water mark-embedded fre- 
quency component signal 105 supplied from the water 
mark data inserting device 140. If the water mark data 
inserting means includes the inverse DCT unit 150, the 
signal supplied from the water mark data inserting 
means is the same as the water mark-embedded image 
data 106. 

Though the DCT unit 1 10 is adopted here, by way 
of an example of means for supplying the resolution sig- 
nal (frequency component signal 102) through the spec- 
trum resolution, any means will do as far as it can 
convert the input signal in the frequency components. 

Fig. 3 is a block diagram showing a constitution of a 
digital data encode system according to a second 
embodiment of the present invention. With reference to 
Fig. 2, the encode system of the embodiment com- 
prises a DCT unit 1 10, a field judging unit 120, a water 
mark data selection output unit 1 30, a water mark data 
inserting device 140, and a quantizing unit 160, and a 
variable-length encoder 170. Fig. 3 shows only the 
characteristic components of the embodiment, while the 
description of other general components is not shown 
there. 

Instead of the inverse DCT unit 150 in the encode 
system of the first embodiment as shown in Fig. 1, the 
encode system of the second embodiment comprises 
the quantizing unit 160, receiving the water mark- 
embedded frequency component signal 105 supplied 
from the water mark data inserting device 140. for sam- 
pling and quantizing the signal data and the variable- 
length encoder 170 for, upon receipt of the signal 107 
quantized by the quantizing unit 160. performing the 
variable-length encoding. The same numerals are 
attached to the DCT unit 110, the field judging unit 120, 
the water mark data selection output unit 130, and the 
water mark data inserting device 140, which are consti- 
tuted in the same way as the respective components of 
the encode system of the first embodiment, so to omit 
their description. The quantizing unit 160 and the varia- 
ble-length encoder 170 may be realized by an informa- 
tion processor and a storage of a personal computer, a 
work station, or the other computer system, under the 
control of the control program, similarly to the other 
components. 

Thus constituted encode system of this embodi- 
ment inserts two kinds of water mark data into the input 
original image data 101 by a series of processing 
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(Steps 401 to 405) similar to the first embodiment as 
described with reference to Fig. 2, quantizes it (Step 
406), and generates the water mark-embedded MPEG 
stream 108 to supply it finally (Step 407), as illustrated 
in the flow chart of Fig. 4. 

In this embodiment, though the description has 
been made in the case of performing the MPEG com- 
pression with the quantizing unit 160 and the variable- 
length encoder 1 70 disposed after the water mark data 
inserting device 140, it is needless to say that it can be 
applied to another image data compression technique 
in the same concept. Namely, as far as it is provided 
with sampling means for sampling the water mark- 
embedded frequency component signal 105 to supply 
the sampling signal and image data compression 
means for processing the sampling signal into a data 
compressed signal to supply the digital data compres- 
sion signal with the water mark-embedded therein, it is 
not restricted to this constitution of the embodiment. 

Fig. 5 is a block diagram showing a constitution of a 
digital data encode system according to a third embodi- 
ment of the present invention. With reference to Fig. 5, 
the encode system of the embodiment comprises a 
OCT unit 110, a signal component judging unit 180, a 
water mark data inserting device 140. and an inverse 
DCT unit 150. Fig. 3 shows only the characteristic com- 
ponents of the embodiment, while the description of 
other general components is not shown there. 

In the above constitution, the same numerals are 
attached to the DCT unit 110, the water mark data 
inserting device 140, and the inverse DCT unit 150, 
which are constituted similarly to the respective compo- 
nents of the encode system of the first embodiment as 
shown in Fig. 1 , thereby omitting their description. The 
signal component judging unit 180 and the water mark 
data selection output unit 190 may be realized by an 
information processor and a storage of a personal com- 
puter, a work station, or the other computer system, 
under the control of the control program, similarly to the 
other components. 

The signal component judging unit 180, upon 
receipt of the original image data 101 including Y-com- 
ponent(brightness component), U-component(first 
color-difference component), and V-component(second 
color-difference component), judges whether the signal 
components under processing is Y-signal, U-signal, or 
V-signal, and supplies the signal component judgement 
information 109 indicating the judgement result to the 
water mark data selection output unit 190. 

The water mark data selection output unit 190 is 
storing three kinds of water mark data 191, 192, and 
193 which are prepared correspondingly to Y-compo- 
nent, U-component, and V-component. Upon receipt of 
the signal component judgement information 109 sup- 
plied from the signal component judging unit 180, the 
unit 190 selects the corresponding one of the water 
mark data 191, 192, and 193 according to the signal 
component indicated by the signal component judge- 
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ment information 109 and supplies the result to the 
water mark data inserting device 140 as the water mark 
data 104. 

An operation of the embodiment will be described 

5 with reference to the flow chart of Fig. 6. At first, three 
kinds of water mark data 191, 192, and 193 prepared 
correspondingly to Y-component, U-component, and V- 
component are stored in the memory of the water mark 
data selection output unit 190 (Step 601). 

w When the signal input port receives the original 
image data 101, the signal component judging unit 180 
judges the signal component of the input original image 
data 101 one after another (Step 602). 

According to the result judged by the signal compo- 

15 nent judging unit 180 in Step 602, the water mark data 
selection output unit 190 selectively assigns the water 
mark data corresponding to the signal component of the 
image data 101 and supplies the same (Step 603). 
Since the processing later than the spectrum reso- 

20 lution of the original image data 1 0 1 by the DCT unit 1 1 0 
has the same operation as that later than Step 204 
according to the first embodiment as illustrated in Fig. 2, 
their description is omitted (Steps 604 to 606). 

As mentioned above, the digital data encode sys- 

25 tern of the embodiment can obtain the water mark- 
embedded image data with three kinds of water mark 
data inserted therein correspondingly to Y-component, 
U-component, and V-component of the original image 
data 101. 

30 Fig. 7 is a block diagram showing a constitution of a 
digital data encode system according to a fourth 
embodiment of the present invention. With reference4o 
Fig. 7, the encode system of the embodiment has the 
same structure as the encode system according to the 

35 third embodiment as shown in Fig. 5. Where, the origi- 
nal image data 101 to be supplied to the DCT unit 110 
and the signal component judging unit 180 is image 
data including R-component(red component), G-com- 
ponent(green component), and B-component(blue 

40 component). Therefore, the signal component judging 
unit 180 judges whether the signal component of the 
original image data 101 under processing is R-signal, 
G-signal, or B-signal and supplies the result as the sig- 
nal component judgement information 109. The water 

45 mark data selection output unit 1 90 stores three kinds of 
water mark data 191. 192, and 193 prepared corre- 
spondingly to R-component, G-component, and B-com- 
ponent, and selects the corresponding one of the water 
mark data 191, 192, and 193 according to the signal 

so component indicated by the signal component judge- 
ment information 109. so to supply the same. 

The operation of the embodiment is similar to the 
operation of the third embodiment as shown in Fig. 6 
other than the processing of dividing the signal compo- 

55 nent of the original image data 101 into R-component, 
G-componertt, and B-component, thereby omitting the 
description thereof. This embodiment can be applied to 
the case of forming the image data by red component 
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(R-component), green component (G-component), and 
blue component (B-component) like a personal compu- 
ter. 

As means of extracting the water mark data from 
the water mark-embedded image data or water mark- 5 
embedded compressed digital data generated by the 
above-mentioned four embodiments, the same method 
as the conventional technique 4 may be used, or other 
method with no need of any original image data may be 
used. For example, the technique for extracting the 10 
water mark data inserted in the frequency components, 
in the existing conventional technique for extracting the 
water mark data, may be generally applicable. There- 
fore, it may be used for the combination of the copy pro- 
tected information included in the water mark data and 15 
the reproducing device having a particular function as 
mentioned in the conventional technique. 

Fig. 8 is a block diagram showing a constitution of 
an inserting device for inserting water mark data in 
image data, in the digital data encode system according 20 
to the fifth embodiment of the present invention. Fig. 10 
is a block diagram showing a constitution of a detecting 
device for detecting the water mark data inserted in the 
image data, in the encode system of the embodiment. In 
this embodiment, the image data subjected to discrete 25 
cosine transform (or spectrum resolution) is overlapped 
with the water mark, similarly to the above-mentioned 
four embodiments. The use of the detecting device as 
shown in Fig. 10 enables detection of the water mark 
data from the water mark-embedded image data, with- 30 
out necessity of the original data. 

With reference to Fig. 8, the encode system of the 
embodiment comprises a DCT unit 810, a water mark 
data inserting device 820, a water mark data table for I- 
picture 831 , a water mark data table for P-picture 832, a 35 
water mark data table for 6-picture 833, a selector 840, 
an encode control unit 850, and an encode unit 860. 
Fig. 8 shows only the characteristic components of the 
embodiment, while the description of other general 
components is omitted there. Each component of the 40 
embodiment may be realized by an information proces- 
sor and a storage of a personal computer, a work sta- 
tion, or the other computer system, under the control of 
the control program, in the same way as the above- 
mentioned other embodiments. 45 

The DCT unit 810 takes out a block 1 02 of 8 x 8 pix- 
els from the original image 101 that is the subject of 
inserting the water mark data, and performs discrete 
cosine transform on the image data of the block 102 
(hereinafter, referred to as block image data). As means so 
of converting block image data in the frequency compo- 
nents, the spectrum resolution may be performed 
instead of discrete cosine transform, similarly to the 
above-mentioned embodiments. 

The water mark data inserting device 820 inserts 55 
proper water mark data of the water mark data stored in 
the water mark data table for l-picture 831, the water 
mark data table for P-picture 832, and the water mark 



data table for B-picture 833, into the frequency compo- 
nent signal of the block image data supplied from the 
DCT unit 810. The detailed constitution and operation of 
the water mark data inserting device 820 will be 
described below. 

The water mark data table for l-picture 831 stores 
the watermark data for inserting l-picture, the water 
mark data table for P-picture 832 stores the water mark 
data for inserting P-picture, and the water mark data 
table for B-picture 833 stores the water mark data for 
inserting B-picture. 

The selector 840 selects one water mark data of the 
water mark data table for l-picture 831, the water mark 
data table for P-picture 832, and the water mark data 
table for B-picture 833, to supply it to the water mark 
data inserting device 820 according to the picture type 
803 received from the encode control unit 850. 

The encode control unit 850 decides the picture 
type when encoding the block image data, sends the 
picture type signal 803 to the selector 840, and controls 
the encode unit 860. 

The encode unit 860 encodes the output of the 
water mark data inserting device 840 in accordance 
with MPEG under the control of the encode control unit 
850, and generates and supplies the MPEG data 805. 

As illustrated in Fig. 8, the water mark data insert- 
ing device 820 includes a partial average calculator 823 
for calculating the partial average of the absolute values 
of three points around the frequency component signal 
of the block image data supplied by the DCT unit 810 by 
the following formula (1); 

avg(f(i))=(|f(i-1 )| + |f (i)| + |f(i + 1 )|)/3 (1), 

a multiplier 821 for multiplying the water mark data 804 
to be supplied by the selector 840 and the output data of 
the partial average calculator 823, in every element, a 
multiplier 822 for multiplying each output element of the 
multiplier 821 by the constant value a for use in chang- 
ing the size of the water mark, and an adder 824 for 
adding the output data of the multiplier 822 and the out- 
put data of the DCT unit 810 in every element. 

Thus-constituted water mark data inserting device 
820 will perform the following calculation; 

F(i)=f(i) + avg(f(i)) x w(i) x constant a (2) 

Where, i is the number of each element of the frequency 
component of a block of 8 x 8 pixels after zigzag scan, 
f(i) is the output data of the DCT unit 810, avg(f(i)) is the 
partial average of the absolute values of three points 
around the data, and w(i) is the value of each element of 
the water mark data 804 supplied by the selector 840. 

This time, an operation of the embodiment will be 
described with reference to the flow chart of Fig. 9. First, 
based on the processing of the ordinal MPEG compres- 
sion, the original image 101 is taken out in every block 
of 8 x 8 pixels, and the DCT unit 810 performs the dis- 
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crete cosine transform processing on the taken out data 
(Step 901). 

The selector 840 selects a table corresponding to 
the picture type, from the water mark data table for l-pic- 
ture 831, the water mark data table for P-picture 832, s 
and the water mark data table for B-picture 833, accord- 
ing to the picture type 803 supplied from the encode 
control unit 850 and supplies the water mark data 804 to 
the water mark data inserting device 820 (Step 902). 

The water mark data inserting devise 820 inserts io 
the water mark data 804 in the block image data con- 
verted in frequency component by the DCT unit 810 
(Step 903). At this time, the water mark data inserting 
device 820 performs the same calculation as the above 
mentioned formula (2). is 

At last, the encode unit 860 quantizes and encodes 
the data F(i) supplied from the water mark data inserting 
device 820 (Step 904), and generates and supplies the 
MPEG data 805 with the water mark data inserted 
therein (Step 905). 20 

The description will be made about a detecting 
device for detecting the water mark data from the MPEG 
data 805 with the water mark data inserted therein by 
the digital data encode system of the embodiment. With 
reference to Fig. 10 t the water mark data detecting 25 
device of the embodiment comprises a decode unit 
1010, an inverse DCT unit 1020, a display control unit 
1030, a water mark data extracting unit 1040, an adder 
1050, an inner product calculator 1060, a selector 1070, 
a water mark data table for l-picture 1081 , a water mark 30 
data table for P-picture 1082, a water mark data table 
for B-picture 1083, and a statistical similarity calculator 
1090. Fig. 10 shows only the characteristic components 
of the detecting device of the embodiment, while the 
description of other general components is omitted. 35 
Each component of the detecting device of the embodi- 
ment may be realized by an information processor and 
a storage of a personal computer, a work station, or the 
other computer system, under the control of the control 
program. 40 

The decode unit 1010 receives the MPEG data 805 
with the water mark data inserted therein, for example, 
supplied from the digital data encode system according 
to the fifth embodiment as shown in Fig. 8. so to decode 
and inversely quantize it. The output data of the decode 45 
unit 1010 is transferred to the inverse DCT unit 1020 
and the water mark data extracting unit 1040. The 
decode unit 1010 judges the picture type of the MPEG 
data, generates the picture type signal 1001 and sup- 
plies it to the selector 1 070. so 

The inverse DCT unit 1020. upon receipt of the out- 
put data of the decode unit 1010, performs the inverse 
discrete cosine transform processing on it, to generate 
and supply the image data 1 004. The image data 1 004 
is supplied to the display control unit 1030. 55 

The water mark data extracting unit 1040 detects 
the data of 8 x 8 pixel block unit that may become a can- 
didate of the water mark data, from the output data of 
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the decode unit 1010 and supplies it. The detailed con- 
stitution and operation of the water mark data extracting 
unit 1040 will be described later. 

The adder 1050, upon receipt of the data of 8 x 8 
pixel block unit supplied from the water mark data 
extracting unit 1040, adds the data together for one 
screen in every element and supplies the addition 
result. 

The selector 1070, upon receipt of the picture type 
signal 1001 from the decode unit 1010, selects one of 
the water mark data table for l-picture 1081, the water 
mark data table for P-picture 1 082, and the water mark 
data table for B-picture 1083, according to the picture 
type indicated by the signal, and supplies the water 
mark data being stored therein. 

The water mark data table for l-picture 1081, the 
water mark data table for P-picture 1 082, and the water 
mark data table for B-picture 1083 respectively store the 
same water mark data as being stored in the water mark 
data table for l-picture 831 , the water mark data table for 
P-picture 832, and the water mark data table for B-pic- 
ture 833 in the encode system of Fig. 8. 

The inner product calculator 1060, upon receipt of 
the output data of the adder 1050 and the water mark 
data 1002 supplied from the selector 1070, calculates 
the inner product of the both data and supplies it. 

Based on the inner product of the output data of the 
adder 1050 and the water mark data 1002, supplied 
from the inner product calculator 1060, the statistical 
similarity calculator 1090 calculates the statistical simi- 
larity of the both data and supplies it. 

The display control unit 1030 receives the image 
data 1004 supplied from the inverse DCT unit 1020 and 
the output data 1003 of the statistical similarity calcula- 
tor 1090, and performs the output control of the display 
data 1005 based on the image data 1004, according to 
the statistical similarity shown in the output data 1003. 
More specifically, if the statistical similarity shown in the 
output data 1003 is a predetermined value or the more, 
the unit 1030 judges that the same water mark data as 
the water mark data 1002 has been inserted in the 
MPEG data 805. When the water mark data 1002 is of 
the copy-protected content, the display control unit 1030 
copy protects the generated image data 1004 and sup- 
plies it as the display data 1O05. 

As illustrated in Fig. 10, the water mark data 
extracting unit 1 040 includes a partial average calcula- 
tor 1041 for calculating the partial average of the abso- 
lute values of three points around the data of 8 x 8 pixel 
block unit to be supplied from the decode unit 1010 by 
the following formula (3) 

avg(F(i))=(|F(i-1)| + |F(i)| + |F(i + 1)|)/3 (3). 

and a divider 1042 for dividing the data F(i) to be sup- 
plied from the decode unit 1 010 by the partial average 
avg (F(i)) to be supplied from the partial average calcu- 
lator 1041. 
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Thus-constituted water mark data extracting unit 
1040 will perform the following calculation; 

W(i)=F(i)/avg(F(i)) (4) 

5 

Where, i is the number of each element of 8x8 pixel 
block, F(i) is the output data of the decode unit 1010, 
avg(F(i)) is the partial average of the absolute values of 
three points around the data, and W(i) is the data that 
would become a candidate of the water mark data to be 10 
supplied by the water mark data extracting unit 1040. 

This time, an operation of the embodiment will be 
described with reference to the flow chart of Fig. 1 1 . 
First, the decode unit 1010, upon receipt of the MPEG 
data 805 to be inspected, performs the decoding is 
processing in accordance with MPEG on the received 
MPEG data 805 (Step 1 101). 

The inverse DCT unit 1020 performs the inverse 
discrete cosine transform processing on the data 
decoded by the decode unit 1010 and generates the 20 
image data 1004 (Step 1 102). 

The water mark data extracting unit 1040 receives 
the data F(i) of 8 x 8 pixel block supplied from the 
decode unit 1010, performs the calculation of the above 
formula (4), and extracts the data that would become a 2s 
candidate of the water mark data inserted in the data 
F(i) (Step 1103). 

The adder 1050 does a sum of the data values for 
one screen in every element with respect to the 
extracted data of 8 x 8 pixel block unit supplied from the 30 
water mark data extracting unit 1040 (Step 1 104). 

The selector 1070 selects a table corresponding to 
the picture type indicated in the picture type signal 
1001 , from the water mark data table for l-picture 1081 , 
the water mark data table for P-picture 1082, and the 35 
water mark data table for B-picture 1083, according to 
the picture type signal 1001 supplied from the decode 
unit 1010, and supplies the water mark data 1 002 to the 
inner product calculator 1060 (Step 1 105). 

The inner product calculator 1060 calculates the 40 
inner product of the total sum of the extracted data for 
one screen calculated by the adder 1050 and the water 
mark data 1002 supplied from the selector 1070 (Step 
1106). The statistical similarity calculator 1090 calcu- 
lates the statistical similarity according to the inner 45 
product value supplied from the inner product calculator 
1060 (Step 1107). 

At last, the display control unit 1 030 judges whether 
the same water mark data as the water mark data 1002 
has been inserted in the MPEG data 805 or not, so 
depending on the statistical similarity shown in the out- 
put data 1003 of the statistical similarity calculator 1090 
(Step 1108) and performs a proper display control 
depending on the judgement result. 

Thus, the water mark data is detected from the ss 
MPEG data with the water mark data inserted therein 
and a proper operation can be performed in accordance 
with the content thereof. The detecting device of the 



embodiment needs no original image data in detecting 
the water mark data. Therefore, the detecting device 
can be used in the reproducing device of a general user 
having no original image data for the detection of the 
water mark data. 

Though the embodiment adopts MPEG data as the 
data to be transferred from the water mark data insert- 
ing device to the detecting device, it is needless to say 
that it can be applied to the other image data compres- 
sion technique by the similar concept. Further, it may be 
constituted in that the water mark data is inserted 
before performing the inverse discrete cosine transform 
processing, thereby transferring the data as the water 
mark-embedded image data. 

As set forth hereinabove, the digital data encode 
system of the present invention is capable of inserting a 
plurality of water mark data in one image data, thereby 
inserting a plurality of information therein by the water 
mark data. 

Since the present invention divides the image data 
according to the field, signal component, and frame, 
and inserts each water mark data corresponding to the 
division by use of one water mark data inserting device, 
it can realize the insertion of a plurality of water mark 
data into one original image data at the same circuit size 
as the conventional digital data encode system. 

Since the present invention divides the image data 
according to the field, signal component, and frame, 
and inserts each different water mark data for every 
dividing unit, it can reduce the deterioration of the image 
quality compared with the case of inserting a plurality of 
water mark data in every division. 

Although the invention has been illustrated and 
described with respect to exemplary embodiment 
thereof, it should be understood by those skilled in the 
art that the foregoing and various other changes, omis- 
sions and additions may be made therein and thereto, 
without departing from the spirit and scope of the 
present invention. Therefore, the present invention 
should not be understood as limited to the specific 
embodiment set out above but to include all possible 
embodiments which can be embodies within a scope 
encompassed and equivalents thereof with respect to 
the feature set out in the appended claims. 

Claims 

1 . A digital data encode system having a water mark 
data inserting device for inserting water mark data 
into digital data signals having a series of field data, 
comprising: 

a water mark data inserting control means for 
controlling inserting of said water mark by said 
water mark data inserting device; 

wherein said water mark data inserting 
control means divides the digital data signals 
by a predetermined reference and inserts a 
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plurality of different water mark data prepared 
correspondingly to the division into the respec- 
tive digital data of the corresponding divisions 
by use of said water mark data inserting 
device. s 

A digital data encode system as set forth in Claim 1 , 
wherein 

said digital data signals are of a digital data sig- 10 
nal having a series of field data consisting of 
odd fields and even fields of a series of image 
frames, and 

said water mark data inserting control means 
inserts first and second water-mark data differ- 15 
ent from each other and prepared for every odd 
filed and every even field into the respective 
corresponding fields, by use of said water mark 
data inserting device. 

20 

A digital data encode system as set forth in Claim 1 , 
wherein 

said digital data signals are of a digital data sig- 
nal having a series of field data consisting of 25 
odd fields and even fields in a series of image 
frames, and 

said water data inserting control means com- 
prising 

a field judging means (1 20) for judging whether 30 
the filed data under processing is of an odd 
field or an even field upon receipt of the digital 
data signals, and 

a water mark data selection output means 
(1 30), storing first and second water mark data 35 
(131, 132) different from each other and pre- 
pared for every odd field and every even field, 
for supplying the first water mark data (131) to 
said water mark data inserting device (140) 
when the judgement result designates the odd 40 
field, or supplying the second water mark data 
(132) to said water mark data inserting device 
(140) when the judgement result designates 
the even filed, depending on the judgement 
result by said field judging means (120). 45 

A digital data encode system as set forth in Claim 1 , 
wherein 

said water mark data inserting control means 50 
inserts a plurality of different water mark data 
(191, 192. 193) prepared for every signal com- 
ponent of the digital data signals extracted by a 
predetermined reference into the respective 
digital data signals of the corresponding signal 55 
components, by use of said water mark data 
inserting device. 



5. A digital data encode system as set forth in Claim 1 f 
wherein 

said water mark data inserting control means 
comprising 

a signal component judging means (180) for, 
upon receipt of the digital data signals, judging 
whether the signal component of the digital 
data signal under processing is brightness 
component, first color-difference component, 
or second color-difference component, and 
a water mark data selection output means 
(190), storing three kinds of different water 
mark data (191, 192, 193) prepared for every 
signal component of the above three kinds, for 
supplying the water mark data (191) prepared 
correspondingly to the brightness component 
to said water mark data inserting device (140) 
when the judging result designates the bright- 
ness component, supplying the water mark 
data (1 92) prepared correspondingly to the first 
color-difference component to said water mark 
data inserting device (140) when the judge- 
ment result designates the first color-difference 
component, or supplying the water mark data 
(193) prepared correspondingly to the second 
cotor-difference component to said water mark 
data inserting device (140) when the judge- 
ment result designates the second color-differ- 
ence component, depending on the judgement 
result of said signal component judging means 

(180). ; 

6. A digital data encode system as set forth in Claim 1 , 
wherein 

said water mark data inserting control means 
comprising 

a signal component judging means (180) for, 
upon receipt of the digital data signals, judging 
whether the signal component of the digital 
data signal under processing is red-compo- 
nent, green-component, or blue-component, 
and 

a water mark data selection output means 
(190), storing three kinds of different water 
mark data (191, 192, 193) prepared for every 
signal component of the above three kinds, for 
supplying the water mark data (191) prepared 
correspondingly to the red-component to said 
water mark data inserting device (140) when 
the judgement result designates the red-com- 
ponent, supplying the water mark data (192) 
prepared correspondingly to the green-compo- 
nent to said water mark data inserting device 
(140) when the judgement result designates 
the green-component, or supplying the water 
mark data (193) prepared correspondingly to 
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the blue-component to said water mark data 
inserting device (140) when the judgement 
result designates the blue-component, 
depending on the judgement result of said sig- 
nal component judging means (180). 5 

7. A digital data encode system as set forth in Claim 1 , 
further comprising 



8. A digital data encode system as set forth in Claim 1 , 
further comprising 

a spectrally-resolving means (110) for spec- 20 
trally resolving the digital data signals upon 
receipt of then, and supplying the obtained 
resolved signals, as a subject of inserting the 
water mark data therein, to said water mark 
data inserting device (1 40). and 25 
an inversely-converting means (150), receiving 
the processed signals with the water mark data 
inserted therein by said water mark data insert- 
ing device (140), for inversely converting the 
spectrally-resolved data and supplying the 30 
obtained inversely-converted signals as water 
mark-embedded digital data signals. 

9. A digital data encode system as set forth in Claim 1 , ^ 
further comprising 35 

a discrete cosine transform means (110) for 
performing discrete cosine transform on the 
digital data signals upon receipt of them and 
supplying the obtained transformed signals to 40 
said water mark data inserting device (140) as 
a subject of inserting the water mark data 
therein, and 

an inverse discrete cosine transform means 
(150), receiving the processed signals with the 45 
water mark data inserted therein by said water 
mark data inserting device (140), for perform- 
ing inverse discrete cosine transform on them 
and supplying the obtained inversely-trans- 
formed signals as water mark-embedded dig- so 
ital data signals. 

1 0. A digital data encode system as set forth in Claim 1 , 
further comprising 

55 

a spectrally-resolving means (110) for spec- 
trally resolving the digital data signals upon 
receipt of them and supplying the obtained 



resolved signals to said water mark data insert- 
ing device (140) as a subject of inserting the 
water mark data therein, 
a sampling means (160) for sampling the proc- 
essed signals with the water mark data 
inserted therein by said water mark data insert- 
ing device (140) to supply sampling signals, 
and 

an image compression means (170) for con- 
verting the sampling signals into image-com- 
pressed signals and supplying the obtained 
digital data compression data signals with the 
water mark embedded therein. 

1 1 . A digital data encode system as set forth in Claim 1 , 

said digital data signals being of a digital data 
signal consisting of a series of image frames; 

further comprising 
an encoding means (860) for encoding the dig- 
ital signals with the water mark data inserted 
therein by use of said water mark data inserting 
device, and 

an encode controlling means (850) for control- 
ling said encoding means (860) so to perform 
encoding processing in a plurality of kinds of 
picture types corresponding to the encoding 
methods, 

said water mark data inserting control means 
comprising 

water mark data storing means (831 , 832, 833) 
for storing a plurality of different water mark 
data prepared correspondingly to a plurality of 
picture types for use in said encoding means 
(860) and said encode controlling means (850), 
and 

a water mark data selection output means 
(840) for, depending on the picture type 
decided by said encode controlling means 
(850), selecting the corresponding water mark 
data from said water mark data storing means 
(831, 832, 833) and supplying it to said water 
mark data inserting device (820). 

1 2. A digital data encode system as set forth in Claim 1 , 

said digital data signals being of a digital data 
signal consisting of a series of image frames; 

further comprising 
a spectrally-resolving means (810) for dividing 
the image of the digital data signals into blocks 
of a predetermined size, spectrally resolving 
the corresponding digital data signals in every 
block, and supplying the obtained resolved sig- 
nals to said water mark data inserting device 
(820) as a subject of inserting the water mark 
data therein, 

an encoding means (860) for encoding the dig- 



a spectrally-resolving means (110) for spec- 10 
trally resolving the digital data signals upon 
receipt of them and supplying the obtained 
resolved signals to said water mark data insert- 
ing device (140) as a subject of inserting the 
water mark data therein. 15 
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ital signals with the water mark data inserted 
therein by use of said water mark data inserting 
device (820), and 

an encode controlling means (850) for control- 
ling said encoding means (860) so to perform s 
encoding processing in a plurality of kinds of 
picture types, 

said water mark data inserting control means 
comprising 

water mark data storing means (83 1 , 832, 833) 10 
for storing a plurality of different water mark 
data prepared correspondingly to a plurality of 
picture types for use in said encoding means 
(860) and said encode controlling means (850), 
and 15 
a water mark data selection output means 
(840) for, depending on the picture type 
decided by said encode controlling means 
(850), selecting the corresponding water mark 
data from said water mark data storing means 20 
(831, 832, 833) and supplying it to said water 
mark data inserting device (820), 
said water mark data inserting device (820) 
comprising 

a partial average calculator (823) for calculat- 25 
ing the average of the absolute values of three 
points around each element in the resolved sig- 
nals supplied from said spectrally-resolving 
means (810), as a partial average, 
a first multiplier (821) for multiplying the water 30 
mark data supplied from laid water mark data 
inserting control means by the output data of 
said partial average calculator (823) in every 
element, 

a second multiplier (822) for multiplying each 35 
element of the output data of said first multiplier 
(821) by a predetermined constant, and 
an adder (824) for adding the output data of 
said second multiplier (822) and the resolved 
signals supplied from said spectrally-resolving 40 
means (810) in every element. 

13. A digital data encode system having a water mark 
data inserting unit including a water mark data 
inserting control means for inserting water mark 45 
data into digital data signals having a series of field 
data by control of a water mark data inserting 
device (820) and a water mark data detecting unit 
including a water mark data detecting means for 
detecting the water mark data from the digital data so 
signals with the water mark data added thereto by 
said water mark data inserting unit: 

said digital data signals being of a digital data 
signal consisting of a series of image frames; ss 
said water mark data inserting unit further com- 
prising 

an encoding means (860) for encoding the dig- 



ital data signals with the water mark data 
inserted therein by use of said water mark data 
inserting device (820), and 
an encode controlling means (850) for control- 
ling said encoding means (860) so to perform 
encoding processing in a plurality of kinds of 
picture types corresponding to the encoding 
methods; 

said water mark data inserting control means 
comprising 

first water mark data storing means (831, 832, 
833) for storing a plurality of different water 
mark data prepared correspondingly to a plu- 
rality of picture types for use in said encoding 
means (860) and said encode controlling 
means (850), and 

a water mark data selection output means 
(840) for, depending on the picture type 
decided by said encode controlling means 
(850). selecting the corresponding water mark 
data from said first water mark data storing 
means (831 , 832, 833) and supplying it to said 
water mark data inserting device (820); 
said water mark detecting unit comprising 
a decoding means (1010) for decoding the dig- 
ital data signals encoded by said encoding 
means (860) of said water mark data inserting 
device, and 

a display controlling means (1030) for control- 
ling display depending on the data decoded by 
said decoding means (1010) according to the 
content of the water mark data inserted in the 
digital data signals or according to its pres- 
ence; 

said water mark data detecting means com- 
prising 

a water mark data extracting device (1040) for 
extracting candidate data, that is a candidate of 
the water mark data, from the data decoded by 
said decoding means, 

a second water mark data storing means 
(1081, 1082, 1083) for storing the same water 
mark data as the plurality of water mark data 
stored in said first water mark data storing 
means of said water mark-data inserting con- 
trol means in said water mark data inserting 
device, 

a water mark data selection output means 
(1070) for selecting the corresponding water 
mark data from said second water mark data 
storing means (1081 , 1082, 1083) according to 
the picture type in the encoding processing to 
be recognized in the decoding processing by 
said decoding means (1010) and supplying it, 
and 

a statistical similarity judging mean (1090) for 
making a comparison between the candidate 
data extracted by said water mark data extract- 
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ing device (1 040) and the water mark data sup- 
plied by said water mark data selection output 
means (1070), judging the statistical similarity 
thereof, and notifying said display controlling 
means (1 030) of the judgement result. 5 

14. A digital data encode system as claimed in Claim 
13, 

said water mark data inserting unit further com- 10 
prising 

a spectrally-resolving means (810) for dividing 
the image of the digital data signals into blocks 
of a predetermined size, spectrally resolving 
the corresponding digital data signals in every 15 
block, and supplying the obtained resolved sig- 
nals to said water mark data inserting device 

(820) as a subject of inserting the water mark 
data therein; 

said water mark data inserting device (820) 20 
comprising 

a partial average calculator (823) for calculat- 
ing the average of the absolute values of three 
points around each element in the resolved sig- 
nals supplied from said spectrally-resolving 25 
means (810), as a partial average, 
a first multiplier (821) for multiplying the water 
mark data supplied from said water mark data 
inserting control means by the output data of 
said partial average calculator (823) in every 30 
element, 

a second multiplier (822) for multiplying each 
element of the output data of said first multiplier 

(821 ) by a predetermined constant, and - 

an adder (824) for adding the output data of 35 

said second multiplier (822) and the resolved 

signals supplied from said spectrally-resolving 

means (810) in every element; 

said water mark data extracting device (1040) 

of said water mark data detecting means com- 40 

prising 

a partial average calculator (1041) for calculat- 
ing the average of the absolute values of three 
points around the block data decoded by said 
decoding means (1010) as a partial average, 45 
and 

a divider (1042) for dividing the block data 
decoded by said decoding means (1010) by 
the output data of said partial average calcula- 
tor (1041). 50 



15. A water mark data inserting method for inserting 
water mark data in digital data signals having a 
series of field data by use of a water mark data 
inserting device, comprising 



55 



a step of, after dividing the digital data signals 
by a predetermined reference, inserting a plu- 



rality of different water mark data prepared cor- 
respondingly to the division into the respective 
digital data of the corresponding divisions, by 
use of said water mark data inserting device. 

16. A water mark data inserting method as set forth in 
Claim 15, wherein ; 

said digital data signals are of a digital data sig- 
nal having a series of field data consisting of 
odd fields and even fields of a series of image 
frames, 

further comprising the steps of: 
a step of storing first and second water mark 
data different from each other and prepared for 
every odd field and every even field, 
a step of judging whether the digital data signal 
is of the odd field or the even field one after 
another, 

a step of selecting one of the first and second 
water mark data as the water mark data to be 
inserted in the digital data signals, according to 
the judgement result in said field judging step, 
a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the first water mark data into the 
frequency analyzed data of the odd field or 
inserting the second water mark data into the 
frequency analyzed data of the even filed, 
according to the selection result in said water 
mark data selecting step. 

17. A water mark data inserting method as set forth in 
Claim 15, further comprising 

a step of storing three kinds of different water 
mark data prepared for every brightness com- 
ponent, first color-difference component, and 
second color-difference component in the sig- 
nal components of the digital data signals, 
a step of judging the signal components of the 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data as the water mark data to 
be inserted in the digital signal data, according 
to the judgement result in said signal compo- 
nent judging step, 

a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the water mark data prepared 
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correspondingly to the brightness component 
into the data of the brightness component, 
inserting the water mark data prepared corre- 
spondingly to the first color-difference compo- 
nent into the data of the first color-difference s 
component, or inserting the water mark data 
prepared correspondingly to the second color- 
difference component into the data of the sec- 
ond color-difference component, according to 
the selection result in said water mark data w 
selecting step. 

18. A water mark data inserting method as set forth 
Claim 15. further comprising 

15 

a step of storing three kinds of different water 
mark data prepared for every red-component, 
green-component, and blue-component in the 
signal components of the digital data signals, 
a step of judging the signal components of the 20 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data as the water mark data to 
be inserted in the digital signal data, according 
to the judgement result in said signal compo- 25 
nent judging step. 

a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 30 
mark data, obtained as a result of the spectrum 
resolution in said spectrally resolving step, 
inserting the water mark data prepared corre- 
spondingly to the red-component into the data 
of the red-component, inserting the water mark 35 
data prepared correspondingly to the green- 
component into the data of the green-compo- 
nent, or inserting the water mark data prepared 
correspondingly to the blue-component into the 
data of the blue-component, according to the 40 
selection result in said water mark data select- 
ing step. 

19. A water mark data inserting method as set forth in 
Claim 15, further comprising 45 

a step of storing a plurality of different water 
mark data prepared for every plurality of picture 
types corresponding to the encoding methods 
in encoding the digital data signals. so 
a step of judging the signal components of the 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data, as the water mark data to 
be inserted in the digital signal data, according 55 
to the judgement result in said signal compo- 
nent judging step, 

a step of spectrally resolving the digital data 



signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the water mark data prepared 
correspondingly to the picture type, according 
to the selection result in said water mark data 
selecting step. 



EP 0 860 997 A2 



CO 
O 



CD Q 



LU 



W CD 

< - 
2 




2 C3 p 

g < < 

O 



EP 0 860 997 A2 



FIG. 2 



C 



START 

v 



STORE TH 
MARK 


IE WATER 
DATA 






JUDGE THE FIELD OF 
THE ORIGINAL IMAGE 
DATA 






SUPPLY THE WATER MARK 
DATA CORRESPONDING 
TO THE FIELD 






DISCRETE COSINE 
TRANSFORM PROCESSING 






INSERT THE WATER 
MARK DATA 






INVERSE DISC 
TRANSFORM 


JRETE COSINE 
PROCESSING 



201 



202 



203 



204 



205 



206 



(" END ^ 



EP 0 860 997 A2 



Q 

OC LU OC 
LU 03 I— 
H 2 CO 

id UJ 

5 °- 

< 2 



§ ' — t 



o 



8 



CO 

O 



o 



cm — 

CO CO 



o 

CO 


■■£-5 


-t-T— 




< CL 






WATER MARK D 
SELECTION OUT 
UNIT 




*! 
cc 
< 

S < 




o 




WATER 
DAT 












EP 0 860 997 A2 



FIG. 4 



C START ^ 



STORE Th 
MARK 


IE WATER 
DATA 






JUDGE THE FIELD OF 
THE ORIGINAL IMAGE 
DATA 






SUPPLY THE WATER MARK 
DATA CORRESPONDING 
TO THE FIELD 






DISCRETE COSINE 
TRANSFORM PROCESSING 






INSERT THE WATER 
MARK DATA 






QUANTIZATION 
PROCESSING 






SUPPLY Tl 
MARK-ENi 
MPEG i 


HE WATER 

1BEDDED 

STREAM 



401 



402 



403 



404 



405 



406 



407 



EP 0 860 997 A2 



O 

uj m Q 
!< 5ui 

< UiO 

> N£ < 

< - 
2 



CO 

o 



o 
to 



ID 




CO Z 


CC =) 


ID 




> rr 


z 









o 



LO 

g 

LL 



O 



CO 
CD 



CM ^~ 





UD 
O 


8 


Q 


ft 




MARK 
Nft hi 




'I 


WATER 


INSERTI 


o 





EP 0 860 997 A2 



FIG. 6 



c 



START 



1 




STORE THE WATER 
MARK DATA 


i 




JUDGE THE SIGNAL 
COMPONENT OF THE 
ORIGINAL IMAGE DATA 






SUPPLY THE WATER MARK 
DATA CORRESPONDING TO 
THE SIGNAL COMPONENT 






DISCRETE COSINE 
TRANSFORM PROCESSING 






INSERT THE WATER 
MARK DATA 






INVERSE DISC 
TRANSFORM 


JRETE COSINE 
PROCESSING 



601 



602 



603 



604 



605 



606 



c 



END 



EP 0 860 997 A2 



UJ 



LU 



- o 

* < 

cr s 

< - 



CO 

o 



o 
in 




O 

UL 



O 



eg 



CNJ t- 



< 


ICE 


o 

O) 








MARK 

UNO LSI 






WATER 


INSERTI 


o 





S uj < 
? CD p 
U < < 

O 



EP 0 860 997 A2 




00 

(D 



EP 0 860 997 A2 



FIG. 9 



Q START ^ 



DISCRETE 
TRANSFORM 


E COSINE 
PROCESSING 






SUPPLY THE WATER MARK 
DATA CORRESPONDING 
TO THE PICTURE TYPE 






INSERT THE WATER 
MARK DATA 






ENCODING PROCESSING 






SUPPLY T» 
MARK-EN/ 
MPEG S 


HE WATER 

IBEDDED 

>TREAM 



901 



902 



903 



904 



905 



Q END ^ 



EP 0 860 997 A2 



CO 




00 

o 


I MARK 

TABLE 

PICTURE 




WATER 
DATA 
FOR B-F 


CM 




00 





LU 
LU DC 



^ — ^ 
LU < Q_ 

^ Q O 



CO 

o 




WATER MARK 
DATA TABLE 
FOR l-PICTURE 





CD 

LL. 



in 
o 
oo 



o 

LU 



EP 0 860 997 A2 



FIG. 11 



START 



ENCODING f 


PROCESSING 






INVERSE DISCRETE COSINE 
TRANSFORM PROCESSING 






EXTRACT THE WATER I 
MARK DATA CANDIDATE | 






CALCULATE THE TOTAL 
VALUE OF THE EXTRACTED 
DATA FOR ONE SCREEN 






SUPPLY THE WATER MARK 

DATA -CORRESPONDING 

TO THE PICTURE TYPE 







CALCULATE THE INNER 

PRODUCT OF THE 
ADDITION RESULT OF 
THE EXTRACTED DATA AND 
THE WATER MARK DATA 







CALCULATE THE 
STATISTICAL SIMILARITY 






JUDGE THE 
OF THE WATE 


PRESENCE 
R MARK DATA 



EP 0 860 997 A2 



Q 

trS< 

LU CO Q 

S oj 

<OJO 

^ * < 
< — 



EE 



o 
in 

CM 



o 

CM 



CO 
CM 



O 
CO 
CM 



\RK DATA 
MEANS 




u 




WATER M/ 
OUTPUT 


ULl Q 




WAl 







o 

CM 



•I ( 



EP 0 860 997 A2 



$2 | 

di 




(19) 




(12) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP> 0 860 997 A3 

EUROPEAN PATENT APPLICATION 



(88) 


Date of publication A3: 


(51) int. a. 7 : mm 5/913 




01.03.2000 Bulletin 2000/09 






(43) 


Date of publication A2: 








26.08.1998 Bulletin 1998/35 






(21) 


Application number: 98103047.1 






(22) 


Date of filing: 20.02.1998 






(84) 


Designated Contracting States: 


(72) 


Inventors: 




AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


© 


Satoh, Shinobu 




NL PT SE 




ftflinato-ku, Tokyo (JP) 




Designated Extension States: 




Wakasu, Yutaka 




AL LT LV MK RO SI 




Minato-Caj, Tokyo (JP) 


(30) 


Priority: 24.02.1997 JP 3873997 


(74) 


Representative: 


25.02.1997 JP 4052597 




von Samson-Himmelstjerna, Friedrich R., Dipl.- 




05.06.1997 JP 14801497 




Phys. et al 








SAMSON & PARTNER 


(71) 


Applicant: NEC CORPORATION 




Widenmayerstrasse 5 




Tokyo (JP) 




80538 Munchen (DE) 



(54) Digital datta encode system 

(57) A digital data encode system for inserting water 
mark data into digital data signals having a series of 
field data by use of a water mark data inserting device 
(140), said digital data encode system comprising a 
field judging unit (120) dividing the digital data signals 
by a predetermined reference, a water mark data selec- 
tion output unit (130) for selecting proper one of a plural- 



ity of different water mark data prepared 
correspondingly to the division according to the judge- 
ment result of the field judging unit (120), and a water 
mark data inserting device (140) for inserting the water 
mark data supplied from the water mark data selection 
output unit (130) into the digital data signals. 



RG. 1 




EP 0 860 997 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 10 3047 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



D,A 



Citation of document with indication, where appropriate, 
of relevant passages 



NIKKEI ELECTRONICS, 

no. 660, 22 April 1996 (1996-04-22), page 
13 XP002126038 

* the whole document * 

WO 96 41468 A (MACROVISION CORPORATION) 
19 December 1996 (1996-12-19) 

* the whole document * 

EP 0 690 595 A (HEWLETT-PACKARD COMPANY) 
3 January 1996 (1996-01-03) 

* the whole document * 



Relevant 
to claim 



1,13,15 



,13,15 



1,13,15 



CLASSIFICATION OF THE 
APPLICATION (lnt.CI.6) 



H04N5/913 



The present search report has been drawn up for all claims 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.6) 



H04N 



Place at March 

THE HAGUE 



Ode ol conpJetion of the mearcb 

17 December 1999 



Verleye, J 



CATEGORY OF CfTED DOCUMENTS 

X • particularly relevant d taken alone 

V : particularly relevant « combined with another 

" document of tho same category 
A : tochnotogieal background 
O : n on- written disclosure 
p : intermediate document 



T : theory or principle underlying tho invention 
E : earlier patent document, but published on, or 

after the fding date 
D : document cited in the application 
L : document cited for other reasons 

jfc : member of the same patent family, corresponding 
document 



EP 0 860 997 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 10 3047 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EOP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

17-12-1999 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



WO 9641468 



19-12-1996 



US 
AU 
AU 
BR 
CA 
EP 
JP 



5659613 A 
700013 B 
5869396 
9608560 
2220845 
0830783 
11507160 



EP 690595 



03-01-1996 



US 
0E 
DE 
JP 



5530751 A 
69507856 D 
69507856 T 

8045179 A 



Publication 
date 



19-08-1997 
17-12-1998 
30-12-1996 
06-07-1999 
19-12-1996 
25-03-1998 
22-06-1999 



25-06-1996 
25-03-1999 
17-06-1999 
16-02-1996 



Si For more details about this annex : see Official Journal of the European Patent Office, No. 1 2/82 



